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1 Introduction 

THE curve reconstruction problem can be thought of as 
connect the dots. The idea is quite similar to Nyquist's 
sampling theorem for band limited signals in signal processing. 
The only difference is in terms of ordering the sample. Unlike 
in the latter case, the ordering is lost when we have a sample 
of data points on a curve. The problem of reconstruction 
thus demands first to establish a proper sampling criterion for 
the curve, next a provable ordering algorithm based on the 
sampling criterion to give a polygonal approximation of the 
original curve, and finaly an interpolating scheme to smooth 
out the corners. The nature of problem to be dealt with in this 
article corresponds to the first. Suppose an object in is in 
motion and we have captured some frames of this motion. 
But these frames are jumbled up, i.e. the ordering is lost. 
Reconstruct the original motion given that the frames captured 
form a dense sample set. 

We extend the ideas of curve reconstruction in Euclidean 
space - to Riemannian manifolds. In this article we 
make an attempt to extend the computational geometric curve 
reconstruction approach to curved spaces. 

It turns out that the riemannian manifold we are interested 
in, S'^(3), is endowed with an additional structure of the 
group, which makes Riemannian manifold into a Lie Group. It 
is a well studied object in physics and mathematics. Although 
no bi-invariant metric exist on SE(3), together with the Rie- 
mannian metric defined on it the exponential map and further 
a left invariant distance metric on SE{3) is expressed in a 
closed form. We give examples of successfully reconstructed 
curves in SE{2) and SE{3). We also show an application of 
curve reconstruction in SE(2) for video frame ordering. We 
show that for a densely sampled curves, minimal spanning 
tree(MST) gives a correct polygonal reconstruction of curves 
in Riemannian manifolds. We also interpolate the ordered 
point set by a partial geodesic interpolation. Further we 



propose to interpolate the ordered point set with de Casteljau 
algorithm assuming the boundary conditions are known. 

2 Background 

We begin with a quick review of curve reconstruction in 
the plane, keeping the notations and definitions as general 
as possible. A curve, for our purpose, is the set of image 
points of a function 7 : [0,1] M. More specifically 
looking at the application at hand, we restrict M to be 
a differentiable manifold. We denote a curve by a symbol 
C. Since it is an image of a compact interval, C is a one 
dimensional compact manifold. It is also differentiable if 7 
is differentiable. C is smooth if 7 is smooth. A subclass of 
curves those are smooth and simple is of vital importance in 
pattern recognition, graphics, image processing and computer 
vision. 

If M is R^ then the problem is of reconstructing curves in 
a plane and C is planar. R^ along with the standard Euclidean 
distance metric becomes a metric space. Naturally the question 
arise, is it always possible to have a finite sample set 5 C C 
which captures everything about C? The answer lies in the 
fact that C is compact and 7 is smooth. To appreciate it more 
clearly let us look at a definition of an e-net. If e > is 
given, a subset 5 of C is called an e-net if S is finite and 
its C C yJsesBs{s), where B^{s) is an open ball in M with 
radius e. In other words if S is finite and its points are scattered 
through C in such a way that each point of C is distant by less 
than e from at least one point of S. Since C is compact every 
cover will have a finite sub-cover, which shows a possibility 
of a finite representative sample set of C. The concept of e-net 
captures the idea of sampling criterion very well. 

In Q, based on the uniform sampling criterion an Euclidean 
MST is suggested for the reconstruction. In the initial phase 
of the development, uniform sampling criterion was the bot- 
tleneck. The first breakthrough came with the non-uniform 
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sampling criterion suggested based on the local feature size by 
(Jl. Unlike the uniform sampling it samples the curve more 
where the details are more. Non-uniform sampling is based 
on the medial axis of the curve. The medial axis of a curve C 
is closure of the set of points in M. which have two or more 
closest points in C. A simple closed curve in a plane divides 
the plane into two disjoint regions. Medial axis can be thought 
of as the union of disjoint skeletons of the regions divided by 
the curve. The Local feature size, f{p), of a point p e C is 
defined as the Euclidean distance from p to the closest point 
m on the medial axis. 

C is e -sampled by a set of sample points S if every p e C 
is within distance e - f{p) of 3. sample s e S. The algorithm 
suggested in [2J works based on voronoi and its dual delaunay 
triangulation. All delaunay based approaches can be put under 
a single formalism, the restricted delaunay complex, as shown 
in 0. Every approach is similar in construction and differs 
only at how it restricts the delaunay complex. The crust |2| 
and further improvements NN-crust |4| can handle smooth 
curves. In some cases |4 1 it is possible to tackle the curves with 
boundaries and also curves in R^, d-dimensional euclidean 
space. The CRUST and NN-CRUST assume that the sample S 
is derived from a smooth curve C. The question of reconstruct- 
ing non smooth cuves have also been studied. An extensive 
experimentation with various curve reconstruction algorithms 
is carried out in f5l. In f6l an extension of NN-CRUST to 
is presented. Which opens up possibilities of extending the 
existing delaunay based reconstruction algorithms to higher 
dimensional euclidean spaces. We show an example of a curve 
in SE{2) reconstructed by NN-CRUST. 



2.1 Organization of tlie article 

In this paper, we pose the problem of curve reconstruction 
in higher dimensional curved spaces. To author's knowledge 
there are no reports of efforts made in this direction. We pose 
the problem as follows. Let be a riemannian manifold. 
C : [0, 1] ^ is a smooth, closed and simple curve. Given 
a finite sample S C C reconstruct the C. Problem involves 
defining the appropriate S, suggesting a provable algorithm 
for geodesic polygonal approximation and an interpolation 
scheme. 

To deal with such objects, we first examine the notion 
of distance on surfaces and then move on to more general 
manifolds in section [S] We make the Riemannian manifold 
into a metric space with the help of the Riemennian inner 
product. Next we examine the metric structure of SE{2) 
and SE{3). With an example in section |4] we show that the 
medial axis based sampling criterion becomes meaningless in 
curved spaces. We define the dense sample set of a curve on 
Riemannian manifolds and show that in section \5\ that it is 
possible to reorder the dense sample set. We present success- 
fully reconstructed curves in SE{2) and SE{3) in section |6] 
And finally we conclude giving due acknowledgements. 



3 Metric Structure on Riemannian 
Manifolds 

3.1 R^ and a surface in R^ 

A curv^in space and a curve on the surface are two different 
entities. R^ can be thought of as a Riemannian manifold 
with the usual vector inner product as the Riemannian metric. 
The tangent space at a point of R^ is also an n-dimensional 
vector space. With the help of the vector inner product 
the length of the curve x : [0, 1] R^ is defined as: 
L{x) = Jq {x' {t)^x' {t))dt. It turns out that the minimum 
length curve between two points in the Euclidean space is a 
straight line segment connecting them. So the distance between 
two points in R^ is given by d{x,y) = \/Xir=i(^* ~ ViY- 
With this as a metric (R"^, d) is a metric space. 

Now let us look at a two dimensional surface M embedded 
in R^. Two dimensions here indicate that each point p e M has 
a neighbourhood homeomorphiJ^ to a subset of R^ . In other 
words, if we associate with each point p e M 3. tangent space 
TpAi then the dimension of TpAi is twc|^ , i.e. two linearly 
independent vectors are required to span TpM. It is now this 
tangent space and the basis vectors of this space which decide 
the Riemannian metric for a given surface. Let us consider a 
surface patch x{u, v) C R^ parametrized by (li, v) eU cM?. 
In this case x is our manifold . Riemannian metric is defined 
as: 

g E {^ui ^u} E {Xui Xy} ^j^^ 

where Xu and Xy are partial derivatives of x{u^ v) w.r.t. u and 
V respectively. Any vector in TpM can be expressed in terms 
of these basis vectors Xu and Xy . The inner product for vectors 
xi, X2 G TpM. is given by {xi,X2)g = xJgijX2, where xi and 
X2 are column vectors. Given a curve 7(t) G M, the length 
of the curve is defined as : 

Lh) = I' ^{l'{t),l'{t))gdt (2) 

Given p, G let 7 be a curve lying in M with p^q sls 
end points. Then 

d{p,q)=mfL{j) (3) 

is a valid metric on A1. A 7* for which the distance between 
two points is minimized is called a geodesic curve on the 
manifold As we will see in the following example, even 
for a simple looking parametrized surface finding a closed 
form expression for the geodesic curve is difficult. In practice, 
7* is obtained by numerical approximations! 8 1. 

Example 1. Let x{u, v) = {u^ v^u ■ v) which leads to Xu = 
(1, 0, v), Xy = (0, 1, u) and E = l-\-v'^, E = u- v and 
G = 1 -\- u^. A curve in x{u^v) is, ^{t) = x{u(t)^v{t)) = 
{u{t)^v{t)^u{t)-v{t)). The length of the curve J {t), t G [to,ti] 
is r \/Eu'^ + 2 • E • u' • v' ^ Gv''^dt, where u' and v' are 

J to 

du/dt and dv/dt respectively. 

1. We restrict out attention to smooth curves, i.e. curves which are C°°. 

2. homeomorphic here can be replaced by dijfeomorphic for a differentiable 
manifold. 

3. For notations and definitions of basic differential geometric terms, we 
have referred to Q. 
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If we try to minimize the length function by Euler-Lagrange 
minimization we get for each of the co-ordinates a second 
order ordinary non-linear differential equation to solve. In this 
example these equations are: 

d^u ^ V dudv 



dt^ 
d^ 
dt^ 



1 



v"^ dt dt 
du dv 



l^u^ ^v'^ dt dt 











(4) 
(5) 



Let the boundary points, the points between which we are try- 
ing to find the geodesic distance, be (1, 1, 1) and (—1, —1, 1). 
We solve the BVP for the above system of equations with 
matlab boundary value solver The resultant geodesic and the 
initial guess are shown in the Figure^ 



4, 
2, 

> ^'J 

3 



Surface (u,v,u.v) 
■Geodesic 
■ Initial guess 



(1,1,1) 




1.5 2 



interpretation of the left invariance is the freedom in choice 
of the inertial reference frame. The matrix representation of 
S, the eucHdean motion group, is denoted by SE{2). And a 
typical element of SE{2) is made up of a rotation matrix and 
a translational vector. Correspondence between S and SE{2) 
is given by 



A typical curve between two configurations in SE{2) and the 
geodesic segment from Ai to A2 are show in Fig|2] 
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Fig. 1 . A bilinear surface and a geodesic 



Fig. 2. Comparision of a curve and a geodesic in SE{2) 
between two configurations Ai and A2. 



3.2 Euclidean Motion Groups 

Consider an object in plane undergoing a rigid body euclidean 
motion. This motion can be decomposed into a rotation with 
respect to the center of mass of the object and a translation of 
the center of mass of the object. All possible configurations 
of an object in plane can be represented by (6>, li, v)(i.e. 
orientation of the principle axis and the co-ordinates of the 
center of mass of the object), where < 6> < 27r and 
(u^v) e M?. Let all such configurations form a set S. It 
is rather intuitive to define a metric on S so as to compare 
two configurations of an object. If Ai = (6>i, 1^1,^1) and 
A2 = (6^2, ^2, ^2) be two configurations in S then it is easy to 
verify that 



d{AuA2) :=y^ 



2)2 + b{ui - U2Y + h{vi - V2Y 



product {Ai,Ai)r = AjRAi, and R 



(6) 

is a valid metric on S corresponding to the riemannian inner 

^ a ^ 
^0 bl2 ^ 

positive definite matrix. Moreover for given ^1,^2, left com- 
position with A G S, i.e A{Ai) = {0 -\-Oi^u-\-ui^v -\-vi), the 
above defined metric leads to d{Ai^A2) = d{A{Ai)^ ^(742)). 
Hence we have a left invariant metric defined on S. Physical 



SE(2) is explored in the domain of image processing for 
segmentation in object tracking where one is interested in 
constrained evolution of the curve under the action of SE{2), 
a lie group. 

In general the group of rigid body motions in is the 
semi-direct product [9J of the special orthogonal group with 
itself. 

SE{n) = SO{n) k R^ 

Unlike R^ the rotations in R^ are not commutative. And that 
reflects in the group composition of SO {3), R1R2 ^ R2R1, 
Ri^R2 ^ SO (3). The product of two rigid body motions 
{Ri,di),{R2,d2) e SE{3) is given by {R2, d2){Ru di) = 
(i?2^i, ^2<^i + <^2)- The matrix representation of elements of 
SE{3) 



SE{3) = {A\A 



R 




,Re S0{3),deR^} (7) 



The tangent space at the group identity in SO (3) and SE{3) 
are the lie algebras so{3) and se{3) respectively. 



so{3) 
se{3) = {S = 



{M|[c^]GR^x^M^ =-M}, 
[u] e so{3),v e R^} 







(8) 
(9) 
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Where [uj] is a skew symmetric matrix |7| corresponding 

,] e R^. The ||a;|| gives the 



to the vector cu 



amount of rotation with respect to the unit vector along uj. 
The exponential map is a diffeomorphism ifTOj connecting the 
lie algebra to the lie group. The exp : se{3) SE{3) is given 
by the usual matrix exponential as exp(S') = XI^q 

Consider a rigid body moving in free space. We fix any 
inertial reference frame {B} at o and a frame {E} to the 
body at some point o' of the body as shown in Figjs] At each 
instance the configuration of the rigid body is described via 
a transformation matrix, A G SE{3), corresponding to the 
displacement from frame {B} to frame {E}. 



{B} 



z 




spectivel, where cji = | [ 1 ], = [ — 6 
cjs = f [ 1 1 ^] andv2=[^ 6 2 ]. 




y-axis 



\-j -6 -5 



.4 -3 -2 -1 



1 



Fig. 4. A geodesic between Ai, A2 g SE(3). 



Fig. 3. Inertial frame {B} and body fixed frames {E} 

So a rigid body motion becomes a curve in SE{3), let A{t) 
be such a curve given by A{t) : [— c, c] SE{3)^ A{t) = 
Rif) d{t) ^.^ algebra element S{t) G se{3) can be 

identified with the tangent vector A\t) at an arbitrary t by: 



S{t)=A-^{t)A\t) 



[uj]{t) v{t) 




(10) 



The u physically corresponds to the angular velocity of the 
body, while v is the linear velocity of the origin 0^ Let us 

assign a riemannian metric g = over SE{3) 

as prescribed in ifTTIl . And so for V = (uJ^v) G se{3), 
{V, V)g = au^uj + /3v^V. It was proved in 1 10] that the 
analytic expression for the geodesic between two configura- 
tions Ai and A2 in SE{3), with g as riemannian metric, is 
given by; 



R{t) = Ri exp([a;o]t) 
d{t) = {d2-di)t^di 



(11) 
(12) 



where [cjq] = log{RjR2) and t G [0,1]. The path is unique 
for Trace{Ri R2) 7^ —1. And the distance between two 
configuration in SE{3) is given by 



d{Ai,A2) = ^a\\ \og{R^'R2W + P\\d2 - (13) 

All the formulas required for computing exp and log maps are 
given in the Appendix|A| for completeness. 

Example 2. Consider two configurations Ai and A2, as 
shown in Fig^ given by vectors {uoi^vi) and {002^^2) re- 



SE{3) is used extensively in robotics for path planning and 
motion planning of robots. It is also useful in computer vision 
and graphics. 

Once the Riemannian metric is identified we can construct 
a distance metric on the manifold. With the distance metric 
•) (corresponding to the geodesic path) defined on the 
Riemannian manifold we are now ready to talk about the 
medial axis and the sampling criterion for a curve on the 
manifold. 

4 Medial Axis, Dense sample and Flat- 
ness 

We proceed by revisiting the definition of the medial axis 
stated previously. Let be a Riemannian manifold and 
•) : M. X M ^ M be the corresponding distance metric. 

Definition 1. The medial axis M of a curve C C AI, is the 
closure of the set of points in M that have at least two closest 
points in C. 

Fig|5] shows examples of medial axis of closed curves on a 
half cylinder and in a plane. It should be noted that the medial 
axis, as defined above, is a subset of the underlying manifold 
in which the curve lies. A curve embedded in a riemannian 
manifold and embedded in will have different medial axes. 
The open disc (ball) of radius e > in M with s e M 
as a center is defined as Ss{s) = {x e M.\d{s^x) < e}. 
In the same manner Bs{s) = {x e M\d{s^x) < e} is a 
closed disc (ball) in M with radius e and the center s. The 
set dB^{s) = {x G M\d{x^ s) = e} is the boundary of Bs{s). 

Definition 2. At a point p on the curve C the local feature size 
f{p) = d{p, M). Where d{p, M) mi{d{p, m),\/m e M}. 
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Fig. 5. Medial axis of a curve on a surface and a curve in 
a plane 



The local feature size at a point on the curve captures the 
behaviour of the curve in the neighbourhood of that point. In 
practice for arbitrary curves it is difficult to identify the medial 
axis. Looking at the construction of the Voronoi diagram |[T2ll 
for a given sample points of a curve the Voronoi vertices do 
capture the behaviour of the medial axis of the sampled curve. 
And so for a densely sampled curve the Voronoi vertices for 
these samples are taken to be the approximate of the medial 
axis of the given curve. It is computationally challenging to 
construct voronoi diagrams on curved spaces L13J . 

4.1 Dense sampling 

A tubular neighbourhood for a curve in a plane is defined as 
the subset of the plane such that every point of the subset 
belongs to exactly one line segment totally contained in the 
subset and normal to the curve. And a disk centred on the 
curve contained in a tubular neighbourhood of the curve is 
called a tubular disk. Let us generalize this definition to curves 
in manifolds. We will also define the notion of a dense sample 
of a curve in manifold based on the tubular neighbourhood. 

Definition 3. Let C C be a smooth curve. Consider 
segments of geodesies that are normal to C and start in C. 
If C is compact, then there exists an e > such that no 
two segments of length e and starting at different points of 
C intersect |14|. The union of all such segments of length 
e is an open neighbourhood T of C, and is called a tubular 
neighbourhood of C. 

We denote the open segment with center p e C and 
radius e in the normal geodesic segment of C at p by (p) . 
Revisiting the definition of the tubular neighbourhood: the 
union Ns{C) = Up^cNs{p) is called a tubular neighbourhood 
of radius e if it is open as a subset of M and the map 
F : C X N^{C) is a diffeomorphism. This 

interpretation is the outcome of result from ifTSl . Let C C M^, 
be a simple closed smooth curve. Existence of the tubular 
neighbourhood is evident from the compactness of the curve 
in M?. We show something more about the value of e in next 
proposition. 



Proposition 1. If N^{C) is a tubular neighbourhood ofC then 
s < ^. Where k = mdiX k{p)^p G C and k{p) is the curvature 
of the curve at point p. 



Proof: Let us define a curve a{s) in by 

a{s) = F{C{s),t) = C{s) + tN{C{s)), 

for a fixed t G {—£j£) such that a{0) = p. N{p) is the unit 
normal to the curve C at p. This new curve belongs to the 
open set N^{C) and 

a{0) =p^tN{p) (14) 
a\0)=C\0)^tC"\0) (15) 
a\0) = (1 - tk{p))C\0) = (dF)(^,,)(C'(0)) (16) 

Since F : C x {—e^e) ^ is a diffeomorphism when 
restricted to C x (—£,£), we have that {dF)(^p^t){C\0)) is a 
non-null vector,i.e. 1 — tk{p) ^ 0. But {—e^e) is connected 
andl-t/c(j9) > Ofort = 0. Thus l-tk{p) > on Cx (-£, e). 
Now if we find out k = max/c(p),p G C then 1 — tk > 0. 
And we have e = t < ^. □ 

Definition 4. A finite sample set 5 C C is called a uniform 
e— sample for some £ > if for any two consecutive sample 
points r, 5 G <S, r G Bs{s). 

Definition 5. A uniform ^-sample 5 of a curve C C is 
dense if there is a real number e > such that UsesBs{s),i.^. 
the union of the closed disks of radius e centred at the sample 
points s e S, forms a tubular neighbourhood of C. 

Proposition 2. For plane curves if e < min^^c f{p) then the 
uniform e-sample S of curve C is a dense sample. 

Proof: By the definition of f{p). □ 
Before we proceed to the main theorem we will discuss few 
observations in the next section. We show by an example how 
the medial axis based sampling fails due to the curvature of 
the underlying riemannian manifold. We also propose to work 
within the injectivity radius of the manifold to avoid such a 
problem. 

4.2 Observations and a Counter Example 

The first two observations are encouraging. And the counter 
example to these to in next section helps in identifying a 
conservative sampling condition. We know that to form a 
dense sample of a curve in it is required to sample with 
the Si < minp^cfip)- The curve and corresponding ei is 
shown in Fig 6(a) | Whereas if the same curve is embedded 




(a) 



(b) 



(a)|A curve C e W and the part of medial axis 
ei is the distance of the point p e C from the 



Fig. 6. 
near p e C 

medial axis of the curve in space, [(b)] The same curve C 
on a surface M and the medial axis distance 62 from the 
point p eC\o the medial axis of the curve on the surface. 



in a surface, as shown Fig 6(b) the required £2 needs to be 
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evaluated on the surface. It turns out that 62 < s\. Let us 
look at another example. A circle in a x?/-plane in can be 




(a) 



(b) 



1 P4 




R \\ 
p ii \ \ 










1 / 



(c) 



Fig. 7. K^Circle with radius R is lying in space (b) Circle 
— ""^ — 

sin 6 



resting on a sphere of radius r 
great circle the sphere of radius R 



(c) 



Circle is the 



thought of as some latitude on a sphere of radius r > 
where L is the length of the circle. In both the cases, circle 
on a plane and circle on a sphere, the sampling required for 
correct reconstruction is different. On sphere we need less 
dense sample set as compared to the plane. In fact as we 
increase the radius r we need denser and denser sample set 
for correct reconstruction and its limiting case, r 00, is 
the plane. In the usual euclidean metric is carried over to 
the points of the circle. In case of sphere the shortest path 
between two points is always along the great circle passing 
through these two points and the length of the segment which 
is shorter is the distance between two points on sphere. With 
this distance metric defined, sphere becomes a metric space. 
And the points of the circle on sphere are endowed with 
this metric. The points of this circle on a sphere are more 
structured then the points of the same circle in the space. The 
additional knowledge of the underlying surface adds up to the 
ordering relation between points of the circle. Since we know 
the surface we know the tangent space and that reduces the 
effort in ordering the sample points. 

Interestingly, when generalized to the curves on manifolds, 
the sampling criterion based only on the medial axis becomes 
meaningless. As an example let us look at a circle of radius 
one on the surface shown in Fig [8] The medial axis of the 
circle on the given surface is the point M = (0, 0, 0). For any 
point on the circle, the distance from the medial axis turns out 
to be larger than the length of the circle itself. Consider the 
limiting case of this surface, a cylinder, suppose the circle is 
on the cylinder. The medial axis point does not exist. 




2 2 



Fig. 8. A circle C and the normal geodesic from a point 

(1,0,1.0629) to M 



The above phenomenon can be understood clearly if we 
look at the cut locus of the point p e M. Following can be 
considered as the defining property of the cut locus of a point 
on the manifold. If 7(^0) is the cut point ofp = 7(0) along 
the geodesic arc 7 then either 7(^0) is the first conjugate point 
of 7(^0) or there exists a geodesic a = 7 from p to 7(^0) such 
that l{a) = / (7) (lengths of a and 7 are equal). 

For example if is a sphere S'^ and p e S'^ then the cut 
locus of p is its antipodal point. And if we consider the sphere 
of radius R the distance of point p from its cut locus is ttR. 



Whereas the distance of the point p on the circle in Fig 7(c) 
to the medial axis M is ^ . Now coming back to the counter 
example Fig [8] we observe that the distance of the p to its cut 
locus d{p, Cm{p)) is less then the distance to the medial axis 
M of the circle. Where Cm{p) is the cut locus of p e M. 

It can be shown that if q e M — Cm {p) there exists a unique 
minimizing geodesic joining p and q. In (13 



i{M) = inf d(jp,Cry 
peM 



ip)) 



(17) 



is called the injectivity radius of A^. So if £ < i{M) then 
exp^ is injective on the open ball Ss{p)- 

Tubular neighbourhood for a curve is constructed by taking 
only the normal geodesies to the curve at a point and assuring 
the injectivity of the expp map along these normal directions. 
We now propose to work inside the injectivity radius to 
straighten out the problem with sampling. 

Proposition 3. Let C e M be a smooth, simple and closed 
curve. If S is a uniform e- sample of C then S is dense for 
€ < mm{mfpec f{p),i{M)}. 

4.3 Flatness of the curve inside a tubular neighbour- 
hood 

If the underlying manifold is a plane and a curve is sampled 
densely then based on the tubular neighbourhood it is proven, 
in m, that euclidean minimal spanning tree reconstructs the 
sampled arc. The crucial argument for the correctness of above 
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is the denseness of the sample. It comes from the observation 
that an arc does not wander too much inside a tubular disk. 
Which avoids the connections between the non-consecutive 
sample points in S, defined as short chords. 

Now we give an alternate proof of flatness of the curve 
segment inside a tubular neighbourhood in plane. And after 
that we extend the proof to curves in the riemannian manifold. 

Theorem 1. Let p and q be two points on an arc C C 
such that q is inside the tubular disk (jp) centred at p. Then 
the sub arc pq ofC is completely inside 5pg/2(c), where c is 
the center of diameter pq. 

Proof: Since q G Bs{p), pq — d{p^ q) < e. Now pq being 
a segment of an arc C there are three possible ways, as shown 
in Figure|9j in which it intersects with 5pg/2(c). 




(a) 



(b) 




(c) 



Fig. 9. 

5. 



(a) The arc touches Bpq/2{c) (b) The arc touches 



pq/2{c) at p and intersects its boundary at q' while pass- 
ing through (7[(c)]The arc intersects boundary of Bpq/2{c) 
at p' and q' wmle passing through p and q respectively 



For the possibility shown in Figure 9(a) it is evident that 
center c lies on two normals passing through p and q, i.e. 
c G pq, since Bpq/2{c) and C share common tangents at p and 
q. This can not happen since Bpq/2{c) C B^{p), a subset of 
a tubular neighbourhood. 

arc C touches 



Let us consider the case in Figure 9(b) 



Bpq/2{c) atp and intersects the boundary of Bpq/2{c) at q and 
q'. We can find out a point q" on the segment qq' which is 
nearest to c. At q" the circle with center c and radius d{c^ q") 
shares a common tangent with C. Hence c lies on the two 
normals pc and q"c. This can not happen inside a tubular 
neighbourhood. 



Finally we consider the Figure |9(c)| On segments pp' and 
qq' we find p" and q" nearest to c. In this case c lies on p"c 
and q"c. Since c is inside tubular neighbourhood this can not 
happen. 

So the only possibility we are left with is that the segment 
pq of curve C lies entirely inside Bpq/2{c). □ 

Theorem 2. Let p and q be two points on an arc C C A4, 




Fig. 10. Tangent space of a point p g M where \ \v\\ 
and the corresponding geodesic A/". 



< s 



where M. is any Riemannian manifold, such that q is inside 
the tubular disk B^{p) centred at p. Then the sub arc pq ofC is 
completely inside 5pg/2(c), where c is the center of diameter 
pq. 

Proof: For := we know that cp, p G S'^~^, is 
orthogonal to TpS""-^. 

Since we are working inside a tubular neighbourhood of the 
curve C, with e as prescribed in Proposition [3j exp : TpM ^ 
is a diffeomorphism. Gauss's lemma 1 15] asserts that the 
image of a sphere of sufficiently small radius(< e) TpM 
under the exponential map is perpendicular to all geodesies 
originating at p Fig[TQ[ 

And the rest of the proof follows from arguments of the 
Theorem[T] □ 

5 Curve Reconstruction on a Rieman- 
nian MANIFOLD 
5.1 Ordering 

We model a curve with a graph where the vertices of the 
graph are the sample points and the edges indicate the order in 
which the vertices are connected. This also implies a geometric 
realization of the graph. If further we put the distance between 
two sample points as the edge cost, it becomes a weighted 
graph. A minimal spanning tree for a weighted graph is a span- 
ning tree for which the sum of edge weights is minimal. To 
keep the notations consistent we define the geodesic polygonal 
path on riemannian manifold as the path along which every 
vertex(sample point) pair is connected by a geodesic segment. 

Computing the minimal spanning tree use the following 
fundamental property, let X U F be a partition of the set of 
vertices of a connected weighted graph G. Then any shortest 
edge in G connecting a vertex of X and a vertex of Y is an 
edge of a minimal spanning tree. If we use MST to model 
an arc, we must ensure that there are no short chords in the 
graph, proved in Q. 

Our work focuses on closed, simple, smooth curves. We 
expect the MST for which every vertex has degree two. In 
other words the sample point has exactly two neighbours 
(samples) on the curve. 

Theorem 3.IfS is a dense sample ofCcA4 then MST gives 
a correct geodesic polygonal reconstruction of S. Where C is 
a smooth, closed and simple curve. 
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Proof: We show that the geodesic polygonal path has no 
short chords. The argument is similar to the proof provided 
for planar case in 1 1 1. For the completeness of the article we 
restate the argument here. Suppose that MST does not give 
a correct geodesic polygonal reconstruction of S. It implies 
that there are two points in MST which are not consecutive. 
Let these points be p, g G S. Since pq is a short chord there 
has to be at least one edge in the sub arc pq which has length 
greater than that of pq. But since the sample S is dense, the 
arc pq must be contained in the disc with diameter pq. Inside 
the disc there is no arc with length greater than the length of 
the diameter. So we have a contradiction. □ 

5.2 Interpolation 

Once we have ordered the given set of points of the curve 
on a curved manifold the next step is to interpolate this point 
set to the desirable granularity. The easiest way to interpolate 
the points is to connect the points via straight line segments, 
a linear interpolation. In general for a manifold like SE{^), 
the geodesies are the exp segments. But this scheme will 
not produce a differentiable curve which might be necessary 
for some applications. Based on the need and application 
one may chose the interpolation scheme. In |16| and |17 | a 
quaternion based approach is suggested and is very useful in 
computer graphics and animation. Since we have represented 
SE{?>) using matrices we would rather stick to matrices. 
Motivated by motion planning purposes various interpolation 
schemes based on variational minimization techniques have 
been proposed and some of them turn out to be quite simple for 
implementations, for a broad overview one will find [181 and 
|[T9ll useful. For the completeness of the reconstruction process 
we have used de Casteljau construction as prescribed in 
1201 , i.e. generalizing the multilinear interpolation on SE{Z), 
a piecewise curve connecting two frames with given 
velocities. The advantage is that the expression is in the closed 
form with exponential and log maps. Suppose we do not know 




Fig. 1 1 . Comparision of Exponential map and smootli 
interpolation in SE(i) between qq = [0,0,0] k [-5,0,0] 
and gi = [7r/2,0,0] k [5,0,0], with tangents vl = 

[0, 0, 0, 3, 1, 1] and vl = [7r/2, 0, 0, -1, -3, -1]. 



a partial geodesic scheme to interpolate between two elements 
of SE{3). Where, the rotational part is interpolated by the exp 
map and the translational component is a interpolated with 
spline segments. 

6 Simulations 

6.1 Curves on a Sphere 

We begin our simulations with examples of curves on a unit 
sphere. We show two curves with different densities required 
by the MST for correct reordering of the samples. 



\Z Sphere of radius one 

* Sample points 
Reconstructed curve 




y-axis 



-1 -1 



x-axis 



(a) 



Sphere of radius one 
Sample points 
-Reconstructed Curve 




y-axis 



x-axis 



(b) 



Fig. 12. Example curves on a unit sphere. 

The curves after reordering the sample points are shown in 



Fig 12(a) and Fig 12(b) 



6.2 Curves in SE{3) 



In Fig 13 an unordered set of frames in 5'^(3) are shown. We 



the velocities at the node points. For such a case we have used assume that the sample shown is dense. 
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Fig. 13. A sample 5 of a curve C c SE{3) 



Fig. 15. Reconstructed curve in SE{3) with finer interpo- 
lation 



By the distance metric defined in Eqn[T3] we compute 
distances between all the frames. Finally we compute the MST 
for the complete weighted graph of frames with the computed 
distances as the edge weights. 



lit 



1^ 



of the form given by Eq[T8]with standard matrix multiplication 
forms a lie group. We can extend the notions of tangent space 
and exponential map to this lie group. As discussed previously 



in Sec |3.2| this group is a semi-direct product of elements of 
scaled rotations and translations. The tangent space elements 
at identity, lie algebra elements, for scaled rotations are given 
by 

r 1 n 1 r n _i 1 

(19) 



(20) 



" 1 


" 




" -1 ■ 





1 


^0 


1 



[a] = A 

And the usual matrix exponentiation gives 

exp [a] 



cost 
sin^ 



- smf 
cos 



Fig. 14. Reconstructed curve in SE{3) 

Once the ordering is done we interpolate the sample with 
partial geodesic scheme. Results of interpolation with two 



different granularities is presented in Fig 14 and Fig 15 



6.3 Curve in SE{3) with scaling parameter 

Suppose for a planar object in motion, we include scaling 
with respect to the center of mass along with the rotation and 
translation. The resultant element will be of the following form 



e^R 




(18) 



This element operates on the point of the object in plane. It 
scalesCe'^) and rotates(i?) the object with respect to its center of 
mass and then translates((i) the center of mass. With each such 
element we can associate a vector [X^O^dx^dy]. The elements 



; O : 

O ; 

..O..i 

c 



o 
o 
o 



C o 



(a) 





^ O q 

o 

o 


: ; ^ 

: oC 

: 0^ 


^ 


o 






. ^ coco o ^ 





(c) 



o 
O 
C 



o 

O 
O 
O 

O 



(b) 



o oO 



Oo 



oC^ OoQ 



(d) 



Fig. 16. 
scaling. 



Various instances of a curve in 5'^(2) with 



We can construct a left-invariant riemannian metric on this 
group. It can be shown that for two elements Ai, A2 in this 
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group 

^(Ai, A2) = Va((Ai - A2)2 + (^1 - 02)') -^p\\d,-d2 II 

(21) 



is a valid distance metric. In Fig [16] a circular object under the 
action of this group is shown for various time steps. Assuming 





(a) 



(b) 



1 


2 


3 


4 


■ 


■ 


■ 


■ 


5 


6 


7 


8 


■ 


■ 


■ 


■ 


9 


10 


11 


12 










13 


14 


15 


16 
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(c) 

Fig. 17. Instances of the reconstructed curve in SE{3) 
with scaling. 

the curve is sampled densely, along with the distance measured 
by Eq|2T] we reconstruct the curve using MST. The success- 
fully reconstructed curve, with the values a = 10 and (3 = 1, 



is shown in Fig [17] Important fact to note here is that the curve 
presented here is not a closed curve. The algorithm is modified 
in this case to take care of the end points. In fact a simple 
nearest neighbour search will also do the job of reconstruction 
once we give in the initial point. 

6.4 Application to video frame sequencing 

As an application of the curve reconstruction we take up a 
task of ordering the frames {Fi}i=i,...,Ar of a video sequence. 



In Fig [18] there are sixteen frames of a video sequence. We use 
the rigid euclidean motion of an object in the frames as a clue 
for re-ordering the frames. Let us assume that the object under 
observation is masked by a rectangle and it is segmented out 
of the frames. We also assume that the motion of the object is 
the rigid body euclidean motion in M?. Further let the video 
frames from the sequence form a dense sample set of the 
motion curve. As discussed in section 13.21 we calculate the 
distances between frames as the distance between elements 
of SE{2). Although we do not focus on how to estimate the 
rotations we give a very primitive looking argument below to 
estimate the distances between two frames. And it turns out 
that the estimates are good enough in this case to reconstruct 
the curve. But in general we use the [O^x^y] as the element 
of SE(2) and we assume that we have an oracle to give these 
frame coordinates to the algorithm. 

The euclidean distances between the means found out from 
the relative positions of the rectangle is the first part of the 



Fig. 18. Unordered video frames 



distance metric. Next we estimate the rotation angle of the 
object with respect to a fixed inertial frame. For this purpose 
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16 
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□ 



Fig. 19. Mean cancellation and rotation estimation 

first we register the objects with their means. An observation 
reveals that if we overlap the registered rectangles the area of 
the overlapping region provides a good estimate of the rotation 
angle. In fact as shown in Fig. for > arctan(^), the over- 
lapped area is where a is the shorter side of the rectangle. 
Which clearly indicates as increase the overlapping area 
decreases upto = 7r/2. For calculating the area we count the 
number of lattice points (pixels) inside the overlapping regions. 
Finally with the estimate for combined with the euclidean 
distance between means give the F2). Using sequential 

search with known initial frame we re-order the frames see 



Fig 20 Even if we do not know about the initial frame, MST 
computes the correct connections of the frames and gives a 
correct ordering upto end points. 

Let us reconsider the distance metric on SE{2) given by 
Eqn|6] If we scale the three axis properly the problem of 
curve reconstruction in SE(2) reduces to the problem of curve 
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Fig. 20. Ordered video frames 



reconstruction in and we may use all the non-uniform 
sampling schemes and voronoi diagram based reconstruction 
algorithms. As an example we have used NN-CRUST to 
reconstruct the curve above in the motion sequence and we 
get the correct ordering as expected. 



7 Conclusion 

We showed that the MST gives the correct geodesic polygonal 
approximation to the smooth, closed and simple curves in 
riemannian manifolds if the sample is dense enough and we 
work inside the injectivity radius. We have worked out a 
conservative bound on the uniform sampling of the curve. The 
effect of local topological behaviour of the underlying mani- 
fold was clearly identified and resolved by working inside the 
injectivity radius. In general the scheme works for the smooth 
arcs with endpoints also. We have presented simulations for 
successfully reconstructed curves in SE{2) and SE{3). We 
have also shown the applications of the combinatorial curve 
reconstruction for ordering motion frames in graphics and 
robotics. 

If we work inside the injectivity radius of the underlying 
manifold we have taken care of the topological changes but 
to take care of geometric changes we need to work inside 
the convexity radius as prescribed in llT3l . We believe that 
the results of non uniform sampling for curves in are 
transferable to the curves in riemannian manifold with careful 
modifications. As an extension to this work we would like to 
work out the necessary proofs and carry out simulations for 
supporting our belief. 



Appendix A 

Exponential and Logarithmic maps 



A 1. Given [u] G so{3) 

sin II 

exp[a;] = I -\ 



■ OJ + 



(22) 



A 2. Let {lo,v) G se(3). Then 



where 





■ [u] 


V 




exp 











exp [u] Av 
1 



(23) 



1 - cos \\uj\\ \\uj\\ - sin IIcjII 



A 3. Given e 50(3) such that Tr{0) -1. Then 

iog{e) = -^{9 - e^) 

2 sm0 



(24) 



where satisfies 1 + 2 cos (j) = Tr{0), < tt. Further more, 

\\\ogOf=cl>\ 

A 4. Suppose e e S0{3) such that Tr{e) / -1, and let 
beR^. Then 



log 

where [uj] = log 0, and 

= / - i • M + 



' e b' 




_ 1 













(25) 



2sin||u;||-||a;||(l- 



- cos \\UJ\ 



2||a;|Psin||c^|| 



A 5. Let 61,62 e S0{3). Then the distance L = d{6i,62) 
induced by the standard bi-invariant metric on 50(3) is 



where 



^^(^l,^2) = ||log(^r'^2) 



denotes the standard Euclidean norm. 



(26) 



A 6. Let Xi = (6>i,6i) and X2 = (^2,^2) be two points 
in SE{3). Then the distance L = d{Xi,X2) induced by the 
scale dependent left-invariant metric on SE{3) is 



d(Xi,X2) = ^c||log(^r^^2)|P +^11^2 - ^ilP (27) 
where || • || denotes the Euclidean norm. 
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